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Abstract  -A  fuzzy  logic  resource  allocation  algorithm  that 
enables  a  collection  of  unmanned  aerial  vehicles  (UAVs)  to  auto¬ 
matically  cooperate  to  make  meteorological  measurements  will 
be  discussed.  Once  in  flight  no  human  intervention  is  required. 
Planning  and  real-time  control  algorithms  determine  the  optimal 
trajectory  and  points  each  UAV  will  sample,  while  taking  into 
account  the  UAVs’  risk,  risk  tolerance,  reliability,  mission  prior¬ 
ity,  fuel  limitations,  mission  cost,  and  related  uncertainties.  The 
approach  is  illustrated  by  a  discussion  of  the  fuzzy  decision  tree 
for  UAV  path  assignment  and  related  simulation.  Simulations 
also  show  the  ability  of  the  control  algorithm  to  allow  UAVs  to 
effectively  cooperate  to  increase  the  UAV  team’s  likelihood  of 
success. 

I.  Introduction 

Knowledge  of  meteorological  properties  is  fundamental  to 
many  decision  processes.  Due  to  personnel  limitations  and 
risks,  it  is  useful  if  related  measurement  processes  can  be  con¬ 
ducted  in  a  fully  automated  fashion.  Recently  developed 
fuzzy  logic  based  algorithms  that  allow  a  collection  of  un¬ 
manned  aerial  vehicles  (UAVs)  and  an  interferometer  platform 
(IP)  [1]  to  automatically  collaborate  will  be  discussed.  The 
UAVs  measure  the  index  of  refraction  in  real-time  to  help 
determine  the  position  of  an  electromagnetic  source  (EMS). 
The  IP  is  actually  an  airplane  with  an  interferometer  onboard 
that  measures  emissions  from  the  electromagnetic  source 
whose  position  is  to  be  estimated.  Each  UAV  has  onboard  its 
own  fuzzy  logic  based  real-time  control  algorithm.  The  con¬ 
trol  algorithm  renders  each  UAV  fully  autonomous;  no  human 
intervention  is  necessary.  The  control  algorithm  aboard  each 
UAV  will  allow  it  to  determine  its  own  course,  change  course 
to  avoid  danger,  sample  phenomena  of  interest  that  were  not 
preplanned,  and  cooperate  with  other  UAVs. 

Section  II  provides  an  overview  of  the  meteorological 
sampling  problem  and  a  high  level  description  of  the  planning 
and  control  algorithms  that  render  the  UAV  team  fully 
autonomous.  Section  III  discusses  the  electromagnetic  meas¬ 
urement  space,  UAV  risk,  UAV  risk  tolerance  and  the  plan¬ 
ning  algorithm.  Section  III  also  discusses  the  UAV  path  con¬ 
struction  algorithm  that  determines  the  minimum  number  of 
UAVs  required  to  complete  the  task,  a  fuzzy  logic  based  ap¬ 
proach  for  assigning  paths  to  UAVs  and  which  UAVs  should 
be  assigned  to  the  overall  mission.  Section  IV  discusses  ex¬ 
perimental  results  including  UAV  path  determination,  UAV 
path  assignment,  determination  of  which  UAVs  should  fly  the 
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mission  and  the  result  of  a  request  for  help  during  the  mission. 
Finally,  section  V  provides  a  summary. 

II.  Meteorological  Sampling  and  Cooperative 
Autonomous  Platforms 

For  many  applications  it  is  useful  to  be  able  to  make  me¬ 
teorological  measurements  in  real-time.  Examples  include 
determining  the  index  of  refraction  of  the  atmosphere  to  facili¬ 
tate  geo-location  [1];  detennination  of  the  presence  and  extent 
of  such  phenomena  as  radio  holes  and  ducts,  which  may  inter¬ 
fere  with  communications;  tracking  atmospheric  contaminants 
[2];  and  sand  suspended  in  the  atmosphere  that  can  interfere 
with  sensors. 

The  fuzzy  logic  based  planning  and  control  algorithms 
that  have  been  developed  allow  a  collection  of  UAVs  making 
up  the  UAV  team  to  engage  in  cooperative  sampling  of  the 
atmosphere  in  real-time  without  human  intervention.  Each 
UAV  will  have  its  own  control  algorithm  allowing  it  to  deter¬ 
mine  new  optimal  trajectories  in  real-time  subject  to  changing 
conditions.  Also,  the  control  algoritlun  on  the  UAVs  will  al¬ 
low  them  to  cooperate  to  increase  the  probability  of  mission 
success.  There  will  be  two  different  types  of  cooperation  al¬ 
lowed  by  the  control  algorithm  and  three  classes  of  help  re¬ 
quests. 

The  first  type  of  cooperation  that  the  UAVs  may  exhibit  is 
to  support  each  other  if  there  is  evidence  that  an  interesting 
physical  phenomenon  has  been  discovered.  If  one  UAV 
seems  to  have  discovered  a  radio  hole,  it  can  request  that  an¬ 
other  UAV  or  UAVs  help  determine  the  extent  of  the  radio 
hole  so  the  IP  can  fly  around  it.  Similar  cooperation  can  be 
carried  out  if  a  UAV  may  have  discovered  other  elevated  ex¬ 
tended  weather  systems. 

The  second  type  of  cooperation  that  the  UAVs  can  exhibit 
through  their  control  algoritlun  is  when  a  UAV  is  malfunction¬ 
ing  or  may  be  malfunctioning.  If  a  UAV’s  internal  diagnostics 
indicate  a  possible  malfunction,  then  it  will  send  out  an  omni¬ 
directional  request  to  the  other  UAVs  for  help.  Each  UAV 
will  calculate  its  priority  for  providing  help  using  a  fuzzy  logic 
procedure  described  below.  The  UAVs  send  their  priority  for 
providing  help  message  back  to  the  requesting  UAV.  The 
requester  subsequently  sends  out  a  message  informing  the 
group  of  the  ID  of  the  highest  priority  UAV.  The  high  priority 
UAV  then  proceeds  to  aid  the  requester. 

The  support  provided  by  the  helping  UAV  can  take  on 
different  forms.  If  the  requester  suspects  a  malfunction  in  its 
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sensors,  the  helper  may  measure  some  of  the  same  points 
originally  measured  by  the  UAV  in  doubt.  This  will  help  es¬ 
tablish  the  condition  of  the  requester's  sensors.  If  additional 
sampling  indicates  the  requester  is  malfunctioning,  and  repre¬ 
sents  a  liability  to  the  group  it  will  retrmi  to  base.  In  this  case 
the  supporter  may  take  over  the  mission  of  the  requester. 
Whether  or  not  the  supporter  samples  all  the  remaining  sample 
points  of  the  requester;  subsequently,  abandoning  its  original 
points  depends  on  the  sample  points’  priorities.  A  frizzy  logic 
based  procedure  for  determining  sample  point  priorities  is 
discussed  below.  If  it  is  established  that  the  requester  is  not 
malfunctioning  or  the  requester  can  still  contribute  to  the  mis¬ 
sion’s  success  it  may  remain  in  the  field  to  complete  its  cur¬ 
rent  mission. 

III.  Planning  and  Risk 

The  measurement  space  consists  of  the  electromagnetic 
propagation  enviromnent  where  UAVs  and  the  IP  make  dieir 
measurements.  This  enviromnent  includes  sample  points  and 
the  desirable  neighborhoods  that  surround  diem.  The  sample 
points  or  the  desirable  neighborhoods  are  where  the  UAVs 
will  make  measurements.  The  method  of  determining  die 
sample  points  and  desirable  neighborhoods  is  described  be¬ 
low. 

The  measurement  space  also  includes  taboo  points  and  die 
undesirable  neighborhoods  that  surround  them.  The  taboo 
points  are  points  of  turbulence  and  odier  phenomena  that 
could  threaten  die  UAVs.  The  undesirable  neighborhoods 
surrounding  diem  also  represent  various  degrees  of  risk.  The 
method  of  specifying  taboo  points  and  quantifying  the  degree 
of  risk  associated  with  their  undesirable  neighborhoods  em¬ 
ploys  fuzzy  logic  and  is  discussed  in  diis  section. 

The  planning  algorithm  allows  the  determination  of  the 
minimum  number  of  UAVs  needed  for  the  mission  subject  to 
fuel  constraints,  risk,  UAV  cost,  and  importance  of  various 
points  for  sampling.  Risk  refers  to  turbulent  regions  or  re¬ 
gions  undesirable  for  other  reasons,  e.g.,  the  presence  of  en¬ 
emy  observers  or  physical  obstructions.  The  planning  algo¬ 
rithm  automatically  establishes  the  order  in  which  to  send  the 
UAVs  taking  into  account  the  UAV’s  value;  onboard  sensor 
payload;  onboard  resources  such  as  fuel,  computer  CPU  and 
memory;  etc.  The  priority  of  sample  points  and  their  desirable 
neighborhoods  are  taken  into  account.  The  planning  algorithm 
also  calculates  the  optimal  path  around  undesirable  regions 
routing  the  UAVs  to  or  at  least  near  the  points  to  be  sampled. 

In  the  planning  phase,  the  location  of  the  EMS  is  un¬ 
known.  Some  positions  are  more  likely  than  others  for  the 
EMS’s  location.  When  establishing  likely  positions  for  the 
EMS,  hmnan  experts  are  consulted.  The  experts  provide  sub¬ 
jective  probabilities  of  the  EMS  being  located  at  a  number  of 
positions.  These  likely  EMS  locations  are  referred  as  hy¬ 
pothesis  positions.  Ray-theoretic  electromagnetic  propagation 
[3]  is  conducted  from  each  hypothesis  position  to  each  inter¬ 
ferometer  element  on  the  IP.  The  points  on  the  sampling  grid 
nearest  the  points  of  each  ray’s  passage  are  the  sample  points. 
The  priority  of  a  sample  point  is  related  to  the  subjective  prob¬ 
ability  of  the  hypothesis  position  from  which  the  associated 


ray  emerges.  Sample  points  arising  from  the  highest  probabil¬ 
ity  hypothesis  positions  have  priority  one;  sample  points  asso¬ 
ciated  with  lower  probability  hypothesis  positions,  priority 
two;  etc. 

Each  sample  point  is  surrounded  by  what  are  referred  to 
as  desirable  neighborhoods.  Depending  on  local  weather, 
topography,  etc.,  the  desirable  neighborhoods  are  generally 
concentric  closed  balls  with  a  degree  of  desirability  assigned 
to  each  ball.  The  degree  of  desirability  characterizes  the  an¬ 
ticipated  variation  in  the  index  of  refraction.  If  for  that  region 
of  the  measurement  space,  the  spatial  variation  of  the  index  of 
refraction  is  slow,  the  degree  of  desirability  may  assume  its 
maximum  value  of  unity  for  a  ball  of  radius  measured  in 
miles.  For  regions  of  space  where  the  index  of  refraction’s 
spatial  variation  is  greater,  the  degree  of  desirability  may  fall 
off  much  more  rapidly,  approaching  the  minimum  value  of 
zero  after  just  a  mile  or  two. 

The  desirable  region  need  not  have  spherical  geometry. 
Rotational  symmetry  may  be  broken  by  a  variety  of  processes, 
e.g..  an  elevated  duct,  a  radio  hole.  etc. 

The  notion  of  a  desirable  neighborhood  is  motivated  by 
the  fact  that  a  sample  point  may  also  be  a  taboo  point  or  reside 
within  an  undesirable  neighborhood.  In  the  case  the  sample 
point  coincides  with  or  is  near  a  taboo  point  and  at  least  part  of 
the  sample  point’s  desirable  neighborhood  falls  within  the 
taboo  point’s  undesirable  neighborhood,  the  UAV  may  only 
sample  within  a  desirable  neighborhood  that  is  consistent  with 
its  risk  tolerance. 

A  point  may  be  labeled  taboo  for  a  variety  of  reasons.  A 
taboo  point  and  the  undesirable  neighborhoods  containing  the 
point  generally  represent  a  tlireat  to  the  UAV.  The  threat  may 
take  the  form  of  high  winds,  turbulence,  icing  conditions, 
mountains,  etc.  The  undesirable  neighborhoods  around  the 
taboo  point  relate  to  how  spatially  extensive  the  tlireat  is.  A 
method  of  quantify  ing  risk  and  incorporating  it  into  the  path 
assignment  algorithm  is  presented  that  offers  conceptual  im¬ 
provements  over  an  approach  previously  developed  [1].  This 
section  uses  luzzy  logic  to  quantify  how  much  risk  a  given 
neighborhood  poses  for  a  UAV.  This  quantitative  risk  is  then 
incorporated  into  the  UAV’s  cost  for  traveling  through  the 
neighborhood  as  described  in  this  section.  Once  the  cost  is 
established  an  optimization  algorithm  is  used  to  determine  the 
best  path  for  the  UAV  to  reach  its  goal. 

When  determining  the  optimal  path  for  the  UAVs  to  fol¬ 
low  both  the  planning  algorithm  and  the  control  algorithm 
miming  on  each  UAV  take  into  account  taboo  points  and  the 
undesirable  neighborhood  around  each  taboo  point.  The  path 
planning  algorithm  and  control  algorithm  will  not  allow  a 
UAV  to  pass  through  a  taboo  point.  Depending  on  the  UAV’s 
risk  tolerance  a  UAV  may  pass  through  various  neighbor¬ 
hoods  of  the  taboo  point,  subsequently  experiencing  various 
degrees  of  risk.  Both  the  concepts  of  risk  and  risk  tolerance 
are  based  on  human  expertise  and  employ  rales  each  of  which 
carry  a  degree  of  uncertainty.  This  uncertainty  is  born  of  lin¬ 
guistic  imprecision  [4],  the  inability  of  human  experts  to  spec¬ 
ify'  a  crisp  assignment  for  risk.  Owing  to  this  uncertainty  it  is 


486 


very  effective  to  specify  risk  and  risk  tolerance  in  terms  of 
fuzzy  logic. 

A.  Risk  Fuzzy  Decision  Tree 

Risk  is  represented  as  a  fuzzy  decision  tree  [5-10],  The 
risk  subtree  defined  below  is  a  subtree  of  the  larger  risk  tree 
that  was  actually  used.  The  risk  tree  is  used  to  define  taboo 
points  and  the  undesirable  neighborhoods  surrounding  the 
taboo  points. 

The  root  concepts  on  the  risk  tree  use  the  membership 
function  defined  in  (1-3), 


Fa  (r  taboo  D) 


1,  if  r  =  0 
3/4,  if  0  <r  <1-  Al 
•  /2,  if  1  Al  <r<  JT-A1 
y4,  if  yfT-Al  <r<JT-Al 
0,  if  r  >  yl~3~-Al 


(1) 


r  =  \ \x-qtabooh 

q taboo  =  position  of  taboo  point. 


(2) 

(3) 


For  purposes  of  determining  the  optimal  path,  the  UAV  is 
assumed  to  follow  a  rectilinear  path  consisting  of  connected 
lines  segments,  where  the  beginning  and  ending  points  of  each 
line  segment  reside  on  the  UAV’s  sampling  lattice.  Let  A  and 
B  be  two  grid  points  on  the  UAV’s  sampling  grid  with  corre¬ 
sponding  position  vectors.  rA  and  rB  ,  respectively.  Denote 
the  Euclidean  distance  between  A  and  B  as  d(rA,rB).  Let 
v(rA,rB)  be  the  speed  at  which  the  UAV  travels  in  going  from 
rA  to  rB  .  If  both  rA  and  rB  are  sample  points  then  the 
UAV  travels  at  sampling  velocity,  otherwise  it  travels  at  non¬ 
sampling  velocity.  The  path  cost  is  given  by 

path  _  cos  t(rA  ,rB)  = 

d{rA Mr, AIfb)-  (6) 

_ 7=7 _ 


where  ntaboo  is  the  number  of  taboo  points,  i.e..  columns  in  the 
taboo  point  matrix 


Taboo  =  [/ 


I  h<h< 


ntaboo  - 


(7) 


where  the  “taboo  point,”  qtaboo  is  the  point  at  which  die  risk 
phenomenon  has  been  observed.  The  root  concepts  used  on 
die  risk  subtree  are  given  in  (4),  and  the  subscript  a  is  an  ele¬ 
ment  of  die  root  concept  set ,  RC,  i.e., 

a  e  RC=  {Mountains,  High  Tension  Wires, 

Buildings,  Trees,  Smoke  Plumes,  Suspended 
Sand,  Birds/Insects,  Other  UA  Vs,  Air  Polution,  (4) 
Civilian,  Own  Military,  Allied  Military,  Neutral 
Military,  Cold,  Heat,  Icing,  Rain,  Fog,  Sleet, 

Snow,  Hail,  Air  Pocket,  Wind,  Wind  Shear,  Hos¬ 
tile  Action/Obser\>ation} 

The  norm  in  equation  (2)  is  typically  taken  as  an  Euclidean 
distance.  The  values  taken  by  the  quantity  Al  will  be  dis¬ 
cussed  in  a  future  publication. 

The  fuzzy  membership  function  for  the  composite  concept 
“risk”  is  defined  as 

Mriskivtaboo’30)-  max  Ma  (m  taboo  >  ^  ).  (5) 

aeRC 

B.  Optimal  Paths  and  A  UP  Fuzzy  Decision  Tree 

The  best  path  algorithm  is  actually  an  optimization  algo¬ 
rithm  that  adempts  to  minimize  a  cost  function  to  determine 
the  optimal  trajectory  for  each  UAV  to  follow,  given  a  priori 
knowledge.  The  cost  function  for  the  optimization  algorithm 
takes  into  account  various  factors  associated  with  the  UAV’s 
properties,  mission  and  measurement  space.  Two  significant 
quantities  that  contribute  to  the  cost  are  the  effective  distance 
between  the  initial  and  final  proposed  positions  of  the  UAV 
and  the  risk  associated  with  travel. 


and  tj,i  =  1,2,..., ntaboo are  die  taboo  points  detennined  to  ex¬ 
ists  in  the  measurement  space  when  path _cost(rA,rB) is  cal¬ 
culated.  The  quantity,/?,  is  an  expert  assigned  parameter. 
Note  that  path _cost(rA,rB)  is  an  effective  time.  When  risk  is 

n taboo  \ 

not  present,  i.e..  /?■  X  j.tnsk  (7, , rB  j  is  zero,  then 

i=l 

path _cost(rA,rB)  is  the  actual  travel  time.  When  risk  is  pre¬ 
sent  then  the  travel  time  is  increased.  The  time  increase  will 
be  significant  if  the  risk  is  high. 

If  the  candidate  path  for  the  mission  consists  of  the  fol¬ 
lowing  points  on  the  UAV  lattice  given  by  the  path  matrix  in 
(8). 

Patht  =  [r, ,  r2,  rn],  (8) 

then  the  total  path  cost  is  defined  to  be 

n-l  _  _  (9) 

total  _  cos  t( Pathj )  =  f  path  _  cos  t(  r  ,  r.+I )  . 
j=i 

Determining  the  optimal  path  for  the  ith  UAV  consists  of 
minimizing  the  total  path  cost  given  by  (9)  such  that  there  is 
enough  fuel  left  to  complete  the  path. 

The  planning  algorithm  determines  the  path  each  UAV 
will  pursue,  which  points  will  be  sampled,  the  minimum  num¬ 
ber  of  UAVs  required  for  sampling  the  points  and  makes  as¬ 
signments  of  UAVs  for  measurements  at  particular  points. 
UAVs  are  assigned  as  a  function  of  their  abilities  to  sample 
high  priority  points  first.  The  planning  algorithm  determines 
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flight  paths  by  assigning  as  many  high  priority  points  to  a  path 
as  possible  taking  into  account  relative  distances  including 
sampling  and  non-sampling  velocity,  risk  from  taboo  points, 
and  UAV  fuel  limitations.  Once  flight  paths  are  determined, 
the  planning  algorithm  assigns  the  best  UAV  to  each  path  us¬ 
ing  the  fuzzy  logic  decision  tree  for  path  assignment  described 
in  this  section. 

The  planning  algorithm  must  assign  UAVs  to  the  flight 
paths  determined  by  the  optimization  procedure  described 
below  in  this  section.  This  is  referred  to  as  the  UAV  padi  as¬ 
signment  problem  (UPAP).  The  planning  algorithm  makes 
this  assignment  using  the  following  fuzzy  logic  based  proce¬ 
dure.  To  describe  the  decision  tree  it  is  necessary7  to  develop 
some  preliminary  concepts  and  notation. 

Each  UAV  will  fly  from  lattice  point  to  lattice  point,  i.e„ 
grid  point  to  grid  point,  let  one  such  route  be  given  by  the  ma¬ 
trix  of  points, 


Within  the  path  specified  by  (10).  let  there  be  the  follow¬ 
ing  sample  points  to  be  measured,  .S' , ,  j  =  l,2,...,n  .  Let  the 
function  prio  assign  priorities  to  the  sample  points,  i.e. 
priois. )  is  the  priority  of  the  jth  sample  point.  The  values  that 

priois . )  can  take  are  positive  integers  with  one  representing 

the  highest  priority,  two  the  next  highest  priority,  etc.  The 
mission  priority  (MP)  for  the  Uh  Pathk  is  defined  to  be 


mission  _  prio(Pathk )  =  Z  ~ 


i=l 


prio 


fe)  ’ 


(14) 


The  degree  to  which  the  kth  path  belongs  to  the  related 
fuzzy  concept  MP  is  given  by 


Path  = 


[P,’P2- 


(10) 


Pup  (p  at^k  ) 


mission 


prio[Pathk) 


maxynission  _  prio 

j 


(Pathj)} 


(15) 


where  the  ordering  of  points  gives  the  direction  of  the  route, 
i.e.,  starting  at  P1  and  ending  at  F)  .  Let  die  taboo  points  be 
those  given  in  (7).  Let  the  degree  of  undesirability  of  the 
neighborhood  associated  with  taboo  points,  lt,i  =  l,2,...,ntaboo 

be  denoted  jurisk  (t, ,  P, )  for  the  route  points 

P],j  =  l,2,...,npath  .  The  definition  of  the  mission  risk  (MR) 
is 

/  .  ntaboo  "path  /_  -  \ 

mission  _  risk{Taboo,  Pathk  j  =  Z  Z  Prisk  \f/  >Pj)  (11) 

i=l  j=l 

The  degree  to  which  the  kth  path  belongs  to  the  related 
fuzzy  concept  MR  is  given  by 

Pur  {Taboo,  Pathk )  = 

mission  _risk(Taboo,Pathk)  1  1 

max\inission _ risk^Taboo,  Path  )} 

j 

The  “max"  operation  in  (12)  is  taken  over  the  set  of  all  possi¬ 
ble  UAVs  that  can  be  assigned  to  the  mission. 

A  fuzzy  concept  related  to  “mission  risk”  is  “low  risk.” 
The  fuzzy  membership  function  for  “low  risk”  denoted  as 
jnm  is  defined  as 


The  fuzzy  degree  of  reliability  experts  assign  to  the  sen¬ 
sors  of  UAV(i)  is  denoted  as  jUsr(UAV(i)) .  This  is  a  real 
number  between  zero  and  one  with  one  implying  the  sensors 
are  very  reliable  and  zero  that  they  are  totally  unreliable. 
Likewise,  jumr(UAV(i))  is  die  fuzzy  degree  of  reliability  of 
other  non-sensor  systems  onboard  die  UAV(i).  This  fuzzy 
concept  relates  to  any  non-sensor  system,  e.g..  propulsion, 
computers,  hard  disk,  deicing  systems,  etc.  The  value  of 
UAV(i)  in  units  of  $1000.00  is  denoted  as  V(UAV(i)).  The 
amount  of  fuel  that  UAV(i)  has  at  time  t  is  denoted 
fuel(UAV(i),t).  All  the  UAVs  participating  in  a  mission  are 
assumed  to  leave  base  at  time,  t  =  ta  . 

Let  UAV(i)’s  fuzzy  grade  of  membership  in  the  fuzzy 
concept  “risk  tolerance”  be  denoted  as  prisk-toi  (UAV(/)).  The 
quantity,  prisk-toi  [UA  V(i  jj ,  is  a  number  between  zero  and  one 
and  will  be  simply  referred  to  as  UAV(i)’s  risk  tolerance.  If 
die  risk  tolerance  is  near  zero  then  the  UAV  should  not  be  sent 
on  very  risky  missions.  If  the  UAV’s  risk  tolerance  is  near 
one  then  it  can  be  sent  on  very  risky  missions.  It  seems  natu¬ 
ral  to  compare  “risk  tolerance”  to  “Value.”  So  the  comparison 
can  be  carried  out  on  the  same  footing,  a  fuzzy  concept  of 
value  should  be  defined. 

The  fuzzy  grade  of  membership  of  each  UAV  that  can  be 
assigned  to  the  mission  in  the  fuzzy  concept  “Value”  is  de¬ 
fined  as 


jHL £  {Taboo,  Pathk )  =  min(l,  a  +  1  Mur) 

where  ae  ( 0,1 )  is  an  expert  defined  parameter.  The  function 
of  a  is  to  make  sure  that  “low  risk”  does  not  dominate  calcu¬ 
lations  developed  below. 


M<JAV(,)) - ratueiUAm 

max\Value{UA  V(j ))} 


(16) 


The  advantage  of  the  concept  of  “risk  tolerance”  is  that  it 
gives  the  user  an  extra  concept  to  exploit.  If  the  UAV  is  not  of 
great  relative  value,  but  it  still  might  be  needed  for  a  crucial 
mission  after  the  current  one,  it  might  be  useful  to  give  it  a 
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low  risk  tolerance  so  that  it  is  not  lost  on  the  current  mission. 
This  may  allow  it  to  be  used  on  the  following  mission. 

Another  fuzzy  concept  and  related  fuzzy  membership 
function  that  will  be  defined  is  “fast.”  A  UAV  is  said  to  be 
fast  if  it  takes  a  short  time  to  travel  a  particular  path.  Let  the 
T(UAV(i),Path)  be  the  amount  of  time  it  will  take  UAV(i)  to 
fly  and  make  measurements  along  Path  .  The  fuzzy  member¬ 
ship  function  for  the  concept  “fast”  is  defined  as  follows: 


M  fast  (UA  V(i),  Path)  = 


A, 


rrtmp 


( 


■  mini 


l,a+l- 


v 


T{UAV[i),Path) 

max{j'  ( UA  V(j),  Path )} 

J  y 


(17) 


and 

Artmp  =  x[min(PSr>Pmr  )-£l,rel  ' 

min{l  -  jurisk_toi ,  max(l  -  /iMP ,  e2MP ))- e2M  ]  ( 1  §) 

where  £ipej,£2MP>£3,reie  (^]  arc  expert  assigned  parame¬ 
ters.  The  Heaviside  step  function  denoted  as^  in  (18)  takes 
the  value  one  when  its  argument  is  greater  dtan  or  equal  to 
zero  and  is  zero  otherwise. 

The  term  eIrel  ■  min{l  -  finsk_tol ,  max(l  -  Hmp ,  e2MP ))  in 

die  Heaviside  step  function’s  argument  in  (18)  can  result  in 
K„„p  going  to  zero  if  jUrisk-toi  or  Mmp  are  small  enough.  If 
“Risk  tolerance”  and  “mission  priority”  take  low  values  then 
depending  on  the  value  of  £l  reI ,  the  membership  function  for 
the  fuzzy  concept  “fast”  may  take  the  value  zero.  The  pa¬ 
rameter  e2MP  limits  the  effect  of  “mission  priority.”  Even  if 

the  mission  priority  is  very  high,  risk  tolerance  plays  an  im¬ 
portant  role.  If  the  UAV  has  high  risk  tolerance  and  the  path, 
high  mission  priority  the  UAV  must  have  a  minimum  reliabil¬ 
ity  given  by  £3jei .  Finally,  the  motivation  for  the  concept 

“fast”  is  that  a  fast  UAV  experiences  a  lower  relative  risk 
since  it  is  in  the  field  less  time  and  may  be  exposed  to  risk  for 
a  shorter  duration. 

A  fuzzy  concept  that  combines  “Value”  and  “mission 
risk”  is  “VMR”  and  its  membership  function  denoted  as 
Hvmr  is  defined  as 


PvMR  =  min[min(Mrisk—tol  A~  ll V  )’  AND 2  [flfast ,  fJm  ))  (19) 


The  use  of  AND2  in  (19)  allows  distinctions  to  be  made 
between  various  values  of  /ifast  and  ,uUi .  ff  AND,  were 
replaced  by  a  min  in  (19)  then  if  ju  fast  is  low  enough  then 
min{/i  fast  tfijji )  would  take  the  value  //  fast  independent  of  the 


value  of  Hut  this  would  not  allow  fine  distinctions  to  be 
made. 

The  logical  coimective  AND :  is  defined  as 

AND2{nA,nB)=pAHB  (20) 

The  fuzzy  concept  “RMP”  combines  the  fuzzy  concepts 
“sr.”  “nsr.”  and  “MP  ”  The  fuzzy  membership  function  for 
“RMP.”  denoted  as  /JRMP  is  defined  as 

MrAIP  =  mill(psr  ’ Mnsr  > pMP  )  (^1) 

Both  the  membership  functions  for  “VMR”  and  “RMP”  can  be 
represented  as  fuzzy  decision  trees. 

Finally,  the  fuzzy  membership  function  for  the  fuzzy  con¬ 
cept  “assignment  of  UAV(i)  to  the  path”  (AUP)  is  defined  as 


Maup  - 

AND 2 1 Mump  >  AND 2  (ji^p ,  Hvmr  )] =  Mrmp  '  Mvmr 


(22) 


The  fuzzy  membership  function  for  AUP  is  a  decision  tree 
that  combines  both  “VMR”  and  “RMP”  as  subtrees.  The  use 
of  AND 2  in  (22)  in  two  places  renders  jUAUP  more  sensitive  to 
the  values  of  pmp  and  jUmR  than  it  would  be  if  the  member¬ 
ship  function  for  AUP  took  the  value  min(jUmpp,/ilMR) .  If 
Ha  up  were  to  take  the  value  mini/i^p ,  //.l  MR )  then  a  small 
value  of  Hpajp  such  that  /UpMP  <  would  cause  pAUPto 
take  the  value  of  jUrmp  independent  of  the  value  of  /Uvmr  ■ 
The  use  of  AND 2  instead  of  min  allows  finer  distinctions  to 
be  made.  The  second  degree  dependence  of  in  (22) 
results  in  a  small  value  of  jUAUP  if  Hrmp  ^  small,  but  jUAUP  is 
still  dependent  on  ftmR  .  This  is  consistent  with  expertise.  If 
tiie  sensor  or  non-sensor  reliabilities  or  mission  priority  are 
small.  /-tA,jp  should  be  small.  Low  reliability  or  priority  re¬ 
sults  in  a  faster  decline  in  jUAUP  than  high  mission  risk,  high 
UAV  value,  low  UAV  risk  tolerance  or  the  fact  that  a  reliable 
and  risk-tolerant  UAV  is  slow. 

The  fuzzy  concept  AUP  is  depicted  as  a  tree  in  Fig.  1. 
Leaves  of  the  tree,  i.e.,  those  vertices  of  degree  one  are  labeled 
by  the  names  of  the  fuzzy  concepts  described  above.  Vertices 
are  labeled  by  the  specific  logical  connective  used,  i.e.,  min 
or  AND 2 .  A  circle  on  an  edge  indicates  the  fuzzy  logic  modi¬ 
fier  not.  The  fuzzy  modifier  not  is  defined  as  the  complement 
of  the  fuzzy  set,  i.e.,  let  Ha  be  ^ie  fuzzy  membership  function 
for  the  fuzzy  conceptzl  then  membership  function  for  not  A  is 
given  by  1-jUa. 

Given  the  fuzzy  grade  of  membership  it  is  necessary  to 
defuzzify,  i.e.,  make  definite  UAV-path  assignments.  Simply 
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assigning  the  UAV  with  the  highest  fuzzy  grade  of  member¬ 
ship  for  a  particular  path  to  that  path  can  give  less  than  desir¬ 
able  results.  The  approach  to  defuzzification  taken  is  as  fol¬ 
lows:  if  the  number  of  UAVs  is  denoted  as  nUAV  and  likewise, 
the  number  of  paths  is  denoted  by  n  ath ,  where 
nUAV  >  n  th  then  consider  the  set  of  all  possible  permutations 
of  the  n  th  UAVs  selected  from  a  total  of  nUAV UAVs.  For 
each  assignment  of  n  th  UAVs  to  the  paths,  add  up  the  values 
of  /iAUP  for  that  assignment  over  the  paths.  This  sum  is  re¬ 
ferred  to  as  the  assignment  benefit  (AB).  The  assignment  with 
tlie  highest  AB  is  the  one  selected.  Finally,  a  similar  proce¬ 
dure  is  followed  if  nUAV  <  n  th . 


Figure  1:  The  AUP  subtree  for  the  UAVRM. 

The  decision  tree  for  AUP  given  in  (22)  was  constructed 
using  expertise  provided  by  human  experts.  It  is  a  significant 
improvement  over  a  previously  developed  fuzzy  decision  rule 
for  path  assignment  also  constructed  from  expertise  [11].  An 
alternate  method  of  obtaining  (22)  is  to  evolve  it  using  a  ge¬ 
netic  program  (GP)  [12],  A  GP  is  a  computer  program  based 
on  the  theory  of  evolution  that  evolves  mathematical  expres¬ 
sions  or  computer  programs  that  can  be  considered  optimal  in 
a  sense.  The  GP  has  been  used  as  a  data  mining  function  [12] 
to  create  the  decision  tree  in  (22).  The  GP  data  mined  a  sce¬ 
nario  database  where  each  scenario  had  been  labeled  by  an 
expert.  Expert  rules  were  also  incorporated  to  guide  the  evo¬ 
lutionary  process  and  improve  convergence  time.  The  deci¬ 
sion  tree  in  (22)  has  been  evolved  many  times.  The  GP  finds 
the  same  AUP  decision  tree,  over  and  over  again  independent 
of  the  seed  of  the  random  number  generator  used  to  simulate  a 
random  evolutionary  process. 

IV.  Computational  Experiments 

The  planning  and  control  algorithms  described  in  the  pre¬ 
vious  sections  have  been  the  subject  of  a  large  number  of  ex¬ 
periments.  This  section  provides  a  description  of  a  small  sub¬ 
set  of  these  experiments.  They  serve  to  illustrate  how  the  algo¬ 


rithms  were  tested.  Due  to  space  limitations  only  experiments 
involving  two  or  three  UAVs  are  discussed. 

In  Figs.  2  and  3.  experiments  using  two  UAVs  illustrate 
how  the  control  algorithm  allows  the  UAVs  to  automatically 
support  each  other  to  increase  the  probability  their  joint  mis¬ 
sion  is  successful.  Fig.  4  summarizes  a  three  UAV  experiment 
that  exhibits  the  AUP  decision  tree’s  ability  to  assign  UAVs  to 
paths  in  a  fashion  that  makes  effective  use  of  available  re¬ 
sources. 

Figs.  2-4  use  the  same  labeling  conventions.  Sample 
points  are  labeled  by  concentric  circular  regions  colored  in 
different  shades  of  gray.  The  lighter  the  shade  of  gray  used  to 
color  a  point,  the  lower  the  point’s  grade  of  membership  in  the 
fuzzy  concept  “desirable  neighborhood.”  The  legend  provides 
numerical  values  for  the  fuzzy  grade  of  membership  in  the 
fuzzy  concept  “desirable  neighborhoods.”  If  the  fuzzy  degree 
of  desirability  is  high  then  the  index  of  refraction  is  considered 
to  be  close  to  the  index  of  refraction  of  the  sample  point  at  the 
center  of  the  desirable  neighborhood.  This  allows  the  UAV  to 
make  significant  measurements  while  avoiding  undesirable 
neighborhoods. 

Each  sample  point  is  labeled  with  an  ordered  pair.  The 
first  member  of  the  ordered  pair  provides  the  index  of  the 
sample  point.  The  second  member  of  the  ordered  pair  pro¬ 
vides  the  point’s  priority.  For  example,  if  there  are  nsp  sample 

points  and  the  q,h  sample  point  is  of  priority  p .  then  that 
point  will  be  labeled  with  the  ordered  pair  (q,p). 

Points  surrounded  by  star-shaped  neighborhoods  varying 
from  dark  grey  to  white  in  color  are  taboo  points.  As  with  the 
sample  points,  neighborhoods  with  darker  shades  of  gray  have 
a  higher  grade  of  membership  in  the  fuzzy  concept  “undesir¬ 
able  neighborhood."  The  legend  provides  numerical  values 
for  the  fuzzy  grade  of  membership  in  the  fuzzy  concept  “un¬ 
desirable  neighborhood.”  UAVs  with  high  risk  tolerance  may 
fly  through  darker  grey  regions  than  those  with  low  risk  toler¬ 
ance.  When  comparing  planning  and  associated  control  pic¬ 
tures.  if  a  point  ceases  to  be  taboo,  the  neighborhood  where  it 
resides  is  marked  by  a  very  dim  gray  star  as  well  as  being  la¬ 
beled  by  a  dialog  box  as  being  an  “old  taboo  point.”  New 
taboo  points  and  their  associated  undesirable  neighborhoods 
are  labeled  with  dialog  boxes  indicating  that  they  are  “new.” 

UAVs  start  their  mission  at  the  UAV  base  which  is  la¬ 
beled  with  a  diamond-shaped  marker.  They  fly  in  the  direc¬ 
tion  of  the  arrows  labeling  the  various  curves  in  Figs.  2-3. 

Fig.  2  depicts  the  sampling  path  determined  by  the  plan¬ 
ning  algorithm  for  an  experiment  involving  two  UAVs.  The 
first.  UAV(1)  follows  the  dashed  curve;  the  second,  UAV(2), 
the  solid  curve.  The  UAVs  were  assigned  to  the  different 
paths  by  the  AUP  fuzzy  decision  tree  described  in  section  III. 
UAV(l)  is  assigned  to  sample  all  the  highest  priority  points, 
i.e..  the  priority  one  points.  UAV(2)  samples  the  lower  prior¬ 
ity  points,  i.e.;  those  with  priority  two.  Due  to  the  greedy  na¬ 
ture  of  the  point-path  assignment  algorithm,  the  highest  prior¬ 
ity  points  are  assigned  for  sampling  first. 
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Figure  2:  Trajectory  of  two  UAVs  as  determined  by  the  planning 
algorithm  and  their  paths  assigned  by  AUP. 


Figure  3:  During  flight,  updates  about  environmental  changes  cause 
the  real-time  control  algorithms  on  the  two  UAVs  to  change  their 
trajectories. 


PLAN  PHASE 


Y  Plane 

Figure  4:  Three  UAV  mission  that  provides  an  example  of  the  AUP  decision  tree’s 
assignments. 


Fig.  3  depicts  the  actual  flight  path  the  UAVs  take  during 
real-time.  Initially,  UAV(l)  is  successful  in  measuring  sample 
points  one  and  two  as  assigned  it  by  the  planning  algorithm. 
Just  beyond  sample  point  two,  UAV(l)  experiences  a  mal¬ 
function.  UAV(l)’s  real-time  control  algorithm  subsequently 
sends  out  a  help  request  informing  the  only  other  UAV  in  the 
field,  UAV(2)  of  the  malfunction.  UAV(2)’s  control  algo¬ 
rithm  determines  a  new  path  for  UAV(2)  to  fly  so  that  the  pri¬ 


ority  one  points,  labeled  (3,1)  and  (4,1),  that  UAV(l)  was  not 
able  to  sample  are  subsequently  measured.  After  UAV(2) 
measures  sample  point  five,  its  new  flight  path  allows  it  to 
measure  sample  points  three  and  four.  UAV(2)’s  control  algo¬ 
rithm  determined  it  was  very  important  that  these  priority  one 
points  be  measured.  Unfortunately,  due  to  the  extra  fuel  ex¬ 
pended  in  reassigning  sample  points  three  and  four  to 
UAV(2),  UAV(2)  did  not  have  enough  fuel  to  measure  sample 
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points  seven  and  eight  which  were  of  priority  two.  UAV(2)’s 
real-time  control  algorithm  determined  the  best  possible  solu¬ 
tion  in  the  face  of  changing  circumstances  and  limited  re¬ 
sources. 

Additional  mathematical  details  about  the  fuzzy  decision 
algorithm  that  permits  UAVs  to  help  each  other  are  provided 
in  [11],  A  more  sophisticated  GP  evolved  fuzzy  decision  tree 
that  permits  greater  cooperation  between  UAVs  will  be  the 
subject  of  a  future  publication. 

ft  is  important  to  note  that  the  control  algorithms  running 
on  UAV(l)  and  UAV(2)  direct  both  UAVs  to  alter  their  retinri 
flight  to  the  base  due  to  the  emergence  of  new  taboo  points 
making  the  planning  algorithm  determined  flight  paths  too 
dangerous.  The  control  algorithm  uses  each  UAV's  fuzzy 
risk-tolerance  to  determine  how  near  each  UAV  may  approach 
a  taboo  point. 

Fig.  4  provides  an  example  of  the  AUP  decision  tree’s 
assignment  of  tluee  UAVs  to  tluee  paths.  The  highest  priority 
locations  are  assigned  to  UAV(l)  as  it  has  the  greatest  fuel 
capacity,  i.e.,  90  minutes.  UAV(l)  however  does  not  have 
enough  fuel  to  handle  the  high  priority  points  located  at  posi¬ 
tions  six  and  seven  and  dierefore  UAV(2)  is  assigned  diese 
points  along  with  the  second  degree  high  priority  locations. 

V.  Summary 

Fuzzy  logic  based  planning  and  control  algoriduns  diat 
allow  a  team  of  cooperating  unmanned  aerial  vehicles  (UAVs) 
to  make  meteorological  measurements  have  been  developed. 
The  planning  algorithm  including  the  fuzzy  logic  based  opti¬ 
mization  algoridun  for  flight  path  determination  and  the  UAV 
path  assignment  algorithm  are  discussed.  The  control  algo¬ 
rithm  also  uses  these  fuzzy  logic  algorithms,  but  also  allows 
three  types  of  automatic  cooperation  between  UAVs.  Meth¬ 
ods  of  incorporating  environmental  risk  measures  as  well  as 
expert  measures  of  UAV  reliability  are  discussed  as  they  relate 
to  both  the  planning  and  control  algorithms.  Experimental 
results  are  provided.  The  experiments  show  the  algorithms’ 
effectiveness. 
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